Anybody who votes against Trump is by definition a liberal, and he knows how they're going to vote, even when one is a conservative, and therefore votes how he doesn't know they're going to vote, thereby defining themselves as a liberal if they didn't vote in the way he thought they wouldn't.
I hope that clears it up a little.